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1.  INTRODUCTION 

When  developing  simulation  methodology  it  is  important  to  be  able  to  assess  the 
statistical  efficiency  of  proposed  estimation  procedures.  This  paper  is  concerned  with  the 
assessment  of  the  statistical  efficiency  of  regenerative  methods  for  simulation  of  networks 
of  queues  with  general  service  times.  Our  estimation  procedures  are  applicable  to 
networks  that  have  a  "single  state"  for  passage  times;  regenerative  cycles  are  defined  in 
terms  of  the  single  state.  We  provide  a  comparison  of  two  methods  for  estimation  of 
passage  time  characteristics  in  closed  networks  with  priorities  among  job  classes.  Passage 
times  (informally  the  times  for  a  job  to  traverse  a  portion  of  a  network)  are  important  in 
computer  and  communication  system  models  where  they  represent  job  "response  times." 


The  marked  job  method  (Iglehart  and  Shedler  [9])  prescribes  observation  of  passage 
times  for  an  arbitrarily  chosen,  distinguished  job.  With  the  broadly  applicable  marked  job 
method  the  half-length  of  the  confidence  interval  (obtained  from  a  simulation  of  fixed 
length)  for  the  expected  value  of  a  general  function  /  of  the  limiting  passage  time  is 
proportional  to  a  certain  quantity  e{f).  The  labelled  jobs  method  (Shedler  and  Southard 
[12])  provides  estimates  for  passage  times  through  a  subnetwork.  With  the  labelled  jobs 
method,  observed  passage  times  for  ail  the  jobs  are  used  to  construct  point  and  interval 
estimates  and  (with  the  same  constant  of  proportionality)  the  half-length  of  the 
confidence  interval  is  proportional  to  a  quantity  e°(/).  Since  these  quantities  are 
independent  of  the  blocks  of  the  underlying  regenerative  process,  they  are  appropriate 

t 

measures  of  the  statistical  efficiency  of  the  estimation  procedures.  For  Markovian 
networks  of  queues,  using  computational  results  of  Hordijk,  Iglehart,  and  Schassberger  [S], 
it  is  possible  to  compute  theoretical  values  for  expected  passage  times  and  the  associated 
variance  constants  appearing  in  central  limit  theorems  (c.Lt.’s)  used  to  form  confidence 
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intervals;  here  /  is  the  identity  function.  This  leads  to  a  quantitative  assessment  (Iglehart 
and  Shedler  [8])  of  the  relative  statistical  efficiencies  of  the  estimation  procedures  (for 
expected  passage  times)  in  [7]  for  networks  with  Cox-phase  service  times. 

For  networks  of  queues  with  general  service  times,  there  is  little  hope  of  computing 
the  needed  theoretical  values,  even  for  expected  passage  times.  Using  central  limit 
theorem  and  continuous  mapping  theorem  arguments,  in  this  paper  we  show  that  for  any 
function  f  (and  all  numbers  of  jobs  in  the  network)  Le.,  the  confidence 

intervals  constructed  using  the  labelled  jobs  method  are  shorter  than  those  obtained  from 
the  m^r1^  job  method.  This  is  consistent  with  intuition  since  the  labelled  jobs  method 
extracts  more  passage  time  information  from  a  fixed  length  simulation  run. 

2.  CLOSED,  MULTICLASS  NETWORKS  OF  QUEUES  AND  PASSAGE  TIMES 

We  consider  closed  networks  of  queues  having  a  finite  number  of  jobs  (customers), 
.V.  a  finite  number  of  (single  or  multiple  server)  service  centers,  s,  and  a  finite  number  of 
(muruaily  exclusive)  job  classes,  c.  At  every  epoch  of  continuous  time  each  job  is  in 
exactly  one  job  class,  but  jobs  may  change  class  as  they  traverse  the  network.  Upon 
completion  of  service  at  center  i  a  job  of  class  j  goes  to  center  k  and  changes  to  class  / 
with  probability  p^j^,  where 

?  m  I Pijjcl'  €  c} 

is  a  given  irreducible  Markov  matrix  and  C£  { 1,2,. ..4}  x  { 1 ,2,...,c}  is  the  set  of 

r 

(center,  class)  pairs  in  the  network.  Note  that  in  accordance  with  the  matrix  P  some 
centers  may  never  see  jobs  of  certain  classes.  At  each  service  center  jobs  queue  and 
receive  service  according  to  a  fixed  priority  scheme  among  classes;  the  priority  scheme 


may  differ  from  center  to  center.  Within  a  class  at  a  center,  jobs  receive  service  according 
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to  a  fixed  queue  service  discipline,  e.g.,  first -come,  first-served  (FCFS).  According  to  a 
fixed  procedure  for  each  center,  a  job  in  service  may  or  may  not  be  preempted  if  another 
job  of  higher  priority  joins  the  queue  at  the  center.  (For  technical  reasons,  we  assume 
that  any  interruption  of  service  is  of  the  preemptive-repeat  type.)  A  job  that  has  been 
preempted  receives  additional  service  at  the  center  before  any  other  job  of  its  class  at  the 
center  receives  service. 

All  service  times  are  assumed  to  be  mutually  indeoendent.  We  also  suppose  that 
service  times  at  any  center  have  finite  mean  but  otherwise  arbitrary  density  function  which 
is  continuous  and  positive  on  (0,«).  Parameters  of  the  service  time  distribution  may 
depend  on  the  service  center,  the  class  of  job  in  service,  and  the  "state"  (as  defined  in 
Equation  (2.1)  below)  of  the  entire  network  at  the  time  service  begins.  In  order  to 
characterize  the  state  of  the  network  at  time  t,  we  let  St(t)  denote  the  class  of  the  job  in 
service  at  center  i  at  time  t,  where  i  »  l,2,...,r;  by  convention  S((t)  «  0  if  at  time  t  there 
are  ao  jobs  at  center  /.  If  center  i  has  more  than  one  server,  we  enumerate  the  servers  at 
center  i  and  let  5,(r)  be  a  vector  which  records  the  class  of  the  job  receiving  service  from 
each  server  at  the  center.  (A  job  receives  service  from  the  lowest  numbered  available 
server.)  Denoting  the  number  of  job  classes  serviced  at  center  i  by  k(i)  the  classes  of 

jobs  serviced  at  center  i  ordered  by  decreasing  priority  are  . e*ements 

of  the  set  {l,2,...,c}.  We  denote  by  cj^(f),...,Cj^(f)  the' number  of  jobs  in  queue  at  time 
t  of  the  various  classes  of  jobs  serviced  at  center  i,  i  -  1,2,...^. 

According  to  the  following  scheme,  we  order  the  N  jobs  in  a  linear  stack.  For  tzO 
we  set 

2(0  -  «il ?.,(») C<.,)(0,s,(f);.-;C<')  (r) . (2.1) 

A(t)  J\  ‘  ■'k(i)  '( 


4 


The  job  stack  at  time  t  then  corresponds  to  the  order  of  components  in  the  vector  Z(f) 
after  ignoring  any  zero  components.  V/fchin  a  class  at  a  particular  service  center,  jobs 
waiting  appear  in  the  job  suck  in  PCFS  order;  Le.,  in  order  of  their  arrival  at  the  center, 
the  latest  to  arrive  being  closest  to  the  top  of  the  stack.  The  job  stack  process 
Z  m  {Z(t):t20}  has  a  finite  state  space,  D*. 

For  rzO  denote  by  N(t)  the  position  (from  the  tc  p)  of  the  marked  job  in  the  job 
stack  at  time  t.  Then  set 

X{t)  -  (Z(r),JV(r))  (2.2) 

and  cad  X  —  {X(t):tzQ}  the  augmented  job  stack  process.  Passage  times  are  specified  in 
terms  of  the  marked  job  by  means  of  four  subsets  (Ap  A2,  Bl,  and  2?2)  of  the  sute  space, 
£*,  of  the  stochastic  process  X.  The  sets  A±.  A2  [resp.  3^,  i?2]  jointly  define  the  random 
times  at  which  passage  times  for  the  marked  job  start  [resp.  terminate].  The  sets  Av  A2, 
B\,  and  32  in  effect  determine  when  to  start  and  stop  the  clock  measuring  a  particular 
passage  time  of  the  marked  job.  We  assume  that  the  start  and  termination  times  tor  the 
specified  passage  time  strictly  alternate. 

In  terms  of  the  sets  A  j,  A2,  3  j,  and  B2,  we  define  two  sequences  of  random  times, 
{Sj-.ji 0}  and  {Ty.ji l],  where  S;._t  is  the  start  time  of  the  y'th  passage  time  for  the 
marked  job  and  Tj  is  the  termination  time  of  this  yth  passage  time.  Assuming  that  the 
initial  state  of  the  process  X  is  such  that  a  passage  time  for  the  marked  job  begins  at  r->0. 


let 
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J0-0 

.  Sj  -  in t{rHiTj:  X(t„)€A2,  *(Vi>^ll  jil 

and 

Tj  -  infjr.i^,:  X{rn)€Bv  X{rnJeBx),  j*  1, 
where  {rn:n20}  are  the  jump  times  of  the  process  X.  Then  the  y'th  passage  time  for  the 
marked  job  is  Pj  »  Tj~Sj  V  jz  1. 

Let  £/(*)  be  the  set  of  ail  (i,j)  €  C  such  that  in  state  z€D%  there  is  a  job  of  class  j 
in  service  at  center  /.  For  z,z  £  D’  and  a  —  (/,_/)  €  2/(r),  let  q(z';z,u )  be  the  probability 
that  the  job  stack  process  Z  jumps  (in  one  step)  to  state  s',  given  that  in  state  z  there  is  a 
completion  of  service  to  a  job  of  class  j  at  center  /.  We  write  z-*-r'  when  9(z’;s,u)>0  for 
some  u  €  £/(z).  For  all  zj  €  23*,  we  say  that  z'  is  accessible  from  z  and  write  z  v;'  if 
there  exists  a  finite  sequence  uQ^l,u'1 . a], (center,  class)  pairs  and  job  stacks  such  that 

q(zx  ,z,uQ)q (z2’*\ !  “ i )  .-q{z  ,zn,u\)  >  0.  (2.3 ) 

i 

When  z  W  and  z  ~*z  we  say  that  z  and  z  communicate  and  write  z**z'. 

We  also  define  U(x)  for  x  £  E’.U{x)  -  U(z)  when  x  m  (z,n)  for  some 
z€D*  and  «€{  For  x,x'e£*  and  a  ■  (f,y')€  tf(x),  we  denote  by  p(x';x,u)  the 

probability  that  the  augmented  job  stack  process  X  jumps  to  state  x\  given  that  in  state  x 
there  is  a  completion  of  service  to  a  job  of  class  j  at  center  «.  We  write  x-+x  when 
p(x;x,u)>Q  lor  some  u€  U(x).  We  say  that  x'  is  accessible  from  x  and  write  x  ^x  if 

there  exists  a  finite  sequence  . un  of  (center,  class)  pairs  and  augmented  job 

stacks  such  that 

p(xl;x,u'Q)p(x2;xvu\)...p(x-,xn,un)>0.  (2.4) 

When  and  x  -*x  we  say  that  x  and  x  communicate  and  write  x^*x\ 
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3.  SIMULATION  FOR  PASSAGE  TIMES 

In  the  absence  of  some  restriction  on  the  building  blocks  of  a  network  of  queues 
with  priorities  among  job  classes,  the  sequence  {Pjijtl)  of  passage  times  for  the  marked 
job  need  not  converge  in  distribution  to  a  random  variable  independent  of  the  initial  state 
of  the  system.  We  make  the  further  assumption  that  for  some  €  D’  the  sets 
D  -  { zeD *:  z'-oz}  and  E  m  l(z,n)£E':  z£D}  are  irreducible;  i.e.,  .'w;'  for  ail 
z,z  €D  and  x**x  for  ail  x,x  €  E. 

For  networks  with  two  or  more  service  centers  (s>l),  the  sets  D  and  E  are 

irreducible  (cf.  Shedler  and  Slut2  [10])  if  for  some  service  center  <0  either  k(iQ)  ■  1  (only 

one  class  served  by  center  /Q)  or  service  at  center  i0  to  a  job  of  class  j{  (the  lowest 

priority  job  class  seen  by  center  <0)  is  preempted  when  a  job  of  higher  priority  joins  the 

queue.  Let  z  m  z'^,  the  job  suck  in  which  there  is  one  job  of  class  0)  in  service  at 

center  t'&  and  ,V-1  jobs  of  class  jkVr)(i0)  in  queue  at  center  /'0  (or  in  service  if  center  /'0  is 

a  multiple  server  center).  Then  the  sets  D  ■  {z£D’\  z*  '=>;}  and 

0 

E  »  {{z,n)€E  :  z€D }  are  ineducible. 

Label  the  jobs  from  1  to  N  and  for  ti 0  denote  by  N  (t)  the  label  of  the  job  in 
position  /  of  the  job  suck  at  time  r,  lSisN.  Set 

X°(0  -  (Z(r)*iVl(r)t...*,V'v(r)) 

and  call  X°  the  full y  augmented  job  stack  process.  It  can  he  shown  (cf.  Appendix  1  of 
[7])  that  {Pjjtn*  1],  the  sequence  of  passage  times  (irrespective  of  job  identity) 
enumerated  in  termination  order,  converges  in  distribution  to  a  random  variable  P°. 
Moreover  the  limiting  passage  time  for  any  marked  job.  The  goal  of  the  simulation 


is  estimation  of 
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r(f)  -  EifiP)}, 

where  /  is  a  real-valued  (measurable)  function.  We  assume  that  £{  |  /(?)  |  }<•  and 
P{P€D(f)  m  0}.  where  D(f)  is  the  set  of  discontinuities  of  the  function  /. 

The  marked  job  method 

Define  a  set  S  according  to 

S  m  keAlt  m€A2  and  p(m\k,u)>Q  for  some  u£  U(k)}.  (3.1) 

For  ( k,m )  £  S  the  entrances  of  X  to  state  m  from  state  k  correspond  to  the  starts  of 
passage  times  for  the  marked  job.  For  z€.D  and  n£  {I,2,...JV},  we  write  h{z,n)  m  ( i,j ) 
when  the  job  in  position  n  in  the  job  stack  associated  with  state  z  is  of  class  j  at  center  L 
Now  define  a  subset  S'  of  £  according  to 

S'  m  {(zJ1,z'yn)  6  S:  for  some  single  server  center  i  and  some  (.ijjiO)  £  C, 

0 

h(z,N)  m  (/,_/,(«'))  and  h(z,n)  «  Uj/ii))  with  /„*/,  U n<S)  (3.2) 

and  assume  that  This  condition  ensures  that  there  exists  a  single  state  ((zJV))  of 

the  augmented  job  stack  process  X  such  that  the  marked  job  is  in  service  at  some  single 
server  center,  the  other  N- 1  jobs  are  in  queue  at  the  center  as  jobs  of  equal  or  lower 
priority,  and  with  positive  probability  a  passage  time  for  the  marked  job  starts  upon 
completion  of  the  service  in  progress.  F6r  \t,S,z'n)  £  S'  the  entrances  of  X  to  state 
{z  ,n)  from  single  state  (z,N)  correspond  to  starts  of  passage  times  for  the  marked  job. 
Also  define 

A  2  «  {(r'.n')  £  Ay  (zjf,z',n)  £  S'  for  some  r€  £>}.  (3.3) 
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Then  based  on  a  representation  of  X  as  an  irreducible  generalized  semi-Markov  process  in 
the  sense  of  Whitt  [13],  it  can  he  shown  ([9],  Proposition  (3.1))  that 
P{X{SH)  -  *'  to.}  -  1  for  any  x€A'v 

Select  x  e  Ay  begin  the  simulation  of  X  with  X(0 )  -  x  ,  and  carry  out  the 
simulation  of  X  in  cycles  defined  by  the  successive  entrances  of  {A"(Sn):rtZ0}  to  x  .  Let 
ctm  denote  the  length  (in  discrete  time  units)  of  the  mth  cycle  of  {X(S„):nzO}  and  define 
m  o  and  J3  ■  a,  +  ...  +  a*.,  mzl;  am  is  the  number  of  passage  times  for  the  marked 
job  in  the  mth  cycle.  Also  define 

-  S  W 

for  any  function  /. 

By  Proposition  (3.4)  of  [9],  the  process  {(X(.Sn)J>n+l):n*0}  is  a  regenerative 
process  in  discrete  time.  It  follows  that  the  sequence  of  pairs  of  random  variables 
{( Ym(f),am):mz  1 }  are  independent  and  identically  distributed,  and  since  E{  I  f{P)  I 
by  assumption, 

£{/(?)  1  -  EiYx{f)\/E[ax}. 

With  these  results,  the  standard  regenerative  method  (Crane  and  Iglehart  [4])  applies  and 
(from  a  fixed  number,  n,  of  cycles)  provides  the  strongly  consistent  point  estimate 
?„(/)  »  7„(/)/«„  for  r(f),  where 

?„(/)  -  i  rm{/) 

mm  1 
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and 

-  "-1  2  ®m‘ 

Confidence  intervals  for  r(/)  are  based  on  the  c.l.t. 

nl/2  [',(/)  *  */)]/[(•(/)/£{«!}]  -  mi)  (3.4) 

as  n-»oo,  where  o2(f)  (assumed  finite)  is  the  variance  of  Y j(/)-r(/)aj  and  (V(0,1)  is  a 
standardized  (mean  0,  variance  1)  normal  random  variable. 

77ie  labelled  jobs  method 
Analogous  to  the  set 

S  »  {(kjn):  k  €  A  j,  m€A2  and  p{m;k,u)  >0  for  some  U(k)} 

of  Equation  (3.1),  define  a  set  T  according  to 

T  —  {( k,m ):  keBx,  m€B2  and  p(m\k,u)>0  for  some  «€  U(k)}.  (3.5) 

For  (kjn)  e  T  the  entrances  of  X  to  state  m  from  state  k  correspond  to  the  terminations  >f 
passage  times  for  the  marked  job.  Let  H  »  U  tf2C  C,  where  (i,j)  is  in  H j  [resp.  H2] 
if  it  is  possible  for  the  marked  job  to  be  of  class  j  at  center  t  when  the  passage  time 
specified  by  the  sets  Ax,  A2,  Bx,  and  B2  terminates  [resp.  is  not  underway].  The  labelled 
jobs  method  applies  to  passage  times  for  which  S  O  T so  that  the  set  H  is  nonempty. 
(Passage  times  for  which  SO  T—<t>  correspond  to  passage  of  a  job  through  a  subnetwork.) 

An  element  z  of  the  set  D  is  called  a  single  state  of  the  job  stack  process  for  the 
passage  time  specified  by  the  sets  Ax,  A2,  B j,  and  B-,  if 
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(i)  h(z,rt )  m  (i0.jka0))  €  H  for  some  single  server  center  /'0,  n  m  l,2t...jV; 

and 

(ii)  there  exists  (zl^n)€8l  such  that  (zlt/n)*(z,/»)  for  some  (;,/>)  e£2. 

According  to  this  definition  a  single  state  of  the  job  stack  process  is  a  configuration, 
z.  of  the  job  stack  such  that  no  passage  times  are  underway  (h(z,n)  €  H  for  all  n),  all  jobs 
are  at  the  same  center  (j'0)  with  exactly  one  job  in  service,  and  there  exis  t  such  that  a 
passage  time  for  some  job  terminates  when  the  job  stack  process  jumps  <’>  •: ,  to  z.  We 

assume  that  a  single  state  of  the  job  stack  process  exists. 

Select  a  single  state,  zQ,  of  the  job  stack  process  and  an  initial  state  (r0,/iJ . nN)  for 

the  fully  augmented  job  stack  process  X°.  Let  7^  be  the  termination  time  of  /til. 
Denote  by  {/3®:lcal}  the  indices  of  the  successive  passage  times  (irrespective  of  job 
identity)  which  terminate  with  the  job  stack  process  in  state  zQ.  Let  7^  »  J3°  »  0.  Carry 
out  the  simulation  of  the  process  X°  in  blocks  defined  by  the  successive  epochs 
{ 1  j.  Sec 

rim  -  2  /(^°) 

"'ti¬ 
lt  can  be  shown  ([12],  Proposition  (3.2)  and  (3.4))  that  P{Z{TQn)  «  z  i.o.}  -  1  for 
any  single  state  z  of  the  job  stack  process,  and  that  the  process  {(Z(7'°)„P°+1):/i2:0}  is  a 
regenerative  process  in  discrete  time.  It  follows  that  the  pairs  of  random  variables 
[( y^,(/).a^,):/na  1}  are  independent  and  identically  distributed,  and  since 
£{  I  /(-P0)  !  }  <»  by  assumption. 
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E{f(A]  -  E{Y°x(f) }/E{a°}. 

Then  the  standard  regenerative  method  applies  and  (from  a  fixed  number,  n,  of  blocks) 
provides  the  strongly  consistent  point  estimate 

*2(/>  -  -  i  i  *i 

mm  1  mail 


for  r(f).  Confidence  intervals  for  r(f)  are  based  on  the  c.l.t. 

nW2  K(/)  -  '■(/)]/ [<r°(/)/£{a°}j  -  mi).  (3-6) 

where  (a°(/))2  (assumed  finite)  is  the  variance  of  Y^(f)-r(f) a®. 


(3. 7). EXAMPLE.  Consider  a  network  with  two  service  centers  and  one  job  class.  Let 
C  =.  {(1,1), (2,1)}  and  suppose  that  the  irreducible  routing  matrix  P  is 


P 


P  l-P 
1  0 


(Thus  with  probability  p  a  job  completing  service  at  center  1  joins  the  tail  of  the  queue  at 
center  1  and  with  probability  1  -p  joins  the  queue  at  center  2.  A  job  completing  service  at 
center  2  joins  the  tail  of  the  queue  at  center  1.)  Taking  into  account  the  fixed  number  of 
jobs  in  the  network,  for  riO  let  Z(t)  be  the  number  of  jobs  waiting  or  in  service  at  center 
1  at  time  t.  Then  for  the  job  stack  process  £’*  =■  D  =.  {0,1,. ..*N}  and  for  the  augmented 
job  stack  process 


E"  -  E  -  W,N):  Os/SiV,  l&n&N}. 


Denote  by  P  the  (limiting)  passage  time  which  starts  when  a  job  enters  the  center  1 


queue  upon  completion  of  service  at  center  2  and  terminates  when  the  job  joins  the 
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center  2  queue.  This  passage  time  is  specified  by  the  sets  »  [(i,N):Oit<N}, 

A2  m  {(i,l):0 <isN),  3X  -  and  32  -  {(/,i  +  l):Ok/<W}.  Both  estimation 

methods  are  applicable.  The  set  S  correponding  to  the  starts  of  passage  times  for  the 
marked  job  is 


S  =  {(/..V,/  +  U):  0 &i<#} 

and  the  subset  5'  ™  {(0„,V,1,1)}.  There  is  one  single  state  ((0,-V))  of  the  augmented  job 
stack  process  and  the  set  A2  «  {(1,1)}.  For  the  labelled  jobs  method,  the  state  Zq»0  is  a 
single  state  of  the  job  stack  process. 

4.  COMPARISON  of  methods 

Assume  that  for  the  passage  time  ?,  both  the  marked  job  and  labelled  jobs  methods 

are  applicable;  i.e.,  assume  that  the  set  S'  of  Equation  (3.2)  is  nonempty,  that  the  sets  5 

and  T  of  Equations  (3.1)  and  (3.3)  are  disjoint,  and  that  there  exists  a  single  state  of  the 
* 

job  stack  process.  For  :z0  let  L(c)  be  the  last  state  occupied  by  the  process  X  before 
jumping  to  X(c).  Similarly,  let  L°(r)  be  the  last  state  occupied  by  the  process  X°  be. 
jumping  to  X°(r).  Set  V  -  { K(r):rstO}  and  V°  -  {K°(f):raO},  where  V«)  m  (Z.(r).A’(r)) 
and  V°U)  *  (L°(t),X°(t)).  Denote  the  state  space  of  Fby  F  and  the  state  space  of 
by  F -®.  We  work  with  the  process  V®  and  take  job  1  to  be  the  marked  job.  Selecting  zQ, 
a  single  state  of  the  job  stack  process,  vQ'»  (c0,m',,c0,/n1)  €  T,  and 
v0  *  {z0,m\,m'2 . m'y,z0,ml,m2,...,m>/)  £  F°,  we  set  K°(0)  -  v°. 

Lemma  (4.1)  is  the  basis  for  construction  of  central  limit  theorems  in  continuous 
time  for  sequences  of  passage  times.  Let  {y':&aO}  be  a  renewal  process  defined  on  the 
same  sample  space  as  {P°:.tal}  and  set  'Sj+]  -  +  j-y£.  Let  {P®  :_/al]  be  a  subsequence 
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of  and  denote  by  m‘(t)  the  number  of  ^completed  in  (0,/].  Set 

ak  -  rn  {y\)-m\y k_{)  and 

«*(?») 

Y'k(f>  -  2 

J~m  (y*.j)+1 

(4.1)  LEMMA.  Suppose  that  the  pairs  of  random  variables  {(y£(/),a^):Jlcal}  are 
independent  and  identically  distributed  and  r(f)  m  £{  y*( /)}/£faj}.  Then  provided  that 
£{S|}<«,  £{(aj)2} <»,  and  £{(  y[(  I  / 1  )H <«, 

tl/2  /  _i_  2  f(P°n)  -  r(f)\ /[(E{6\})V1o\f)/E{a\}]  -  jV(0,1) 

V  m  (0  jml  J  S' 

as  f—oo,  where  (/(/))  -  <r2Or1(/)-K/)«J)<». 

Proo f :  Let 

m’(t) 

MO-  2  X*n  )  *  r(f)m\0. 

J-  i  ' 

The  Doeblin  decomposition  is  given  by 

»*(/)  m'(  0 

MO-  2  W/) -*/)«;]  +  2  /(?I)T(/)[m,W-*,(V(l))],(  4.2) 

kml 

where  {/j*(r):r20}  is  the  counting  process  associated  with  the  renewal  process  {y^:£i0}. 
Now  let  Zk(f )  »  Y’k(/)-r(/)a*k  and  observe  that  E{Z’k(f)}  ■  0  and  the  Z*k{f)'s  are 
i.i.d.  by  assumption.  The  weak  law  for  renewal  counting  processes  yields 
n*(r)/f-»l/£{3j}  as  t ■*«.  Using  these  facts,  the  c.l.t.  for  random  panial  sums 
(cf.  Chung  [3],  Theorem  7.3.2  and  Billingsley  [1],  p.  16)  and  the  continuous  mapping 
theorem  (cf.  Billingsley  [2],  Theorem  25.7,  Corollary  1)  we  obtain  the  c.l.t. 
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«*(<)  . 

2  zl(/)/  [*'</)  <1/2/£{«;}]  -  /V(O.l)  (4.3) 

km  l 

as  /-*«•.  From  Equation  (4.3)  we  see  that,  suitably  normalized,  the  first  term  on  the 
right-hand  side  of  Equation  (4.2)  converges  weakly  to  iV(0,l).  The  last  two  terms  on  the 
right-hand  side  of  Equation  (4.2)  are  remainder  terms  which,  when  divided  by  t1'2, 
converge  weakly  to  0.  This  argument  is  standard  (cf.  Iglehart  [6],  p.  279)  but  requires 
£{(<*t)*}  and  E{{YX(  \  f\ ))‘]  to  be  finite.  Using  the  converging  together  theorem 
(cf.  Billingsley  [2],  Theorem  25.4)  and  Equation  (4.3)  we  have 

AO)/ [•*(/)  tin/E{S[}]  -  mi)  (4.4) 

as  t-mao.  FinaUy,  dividing  the  numerator  and  denominator  of  the  left-hand  side  of 
Equation  (4.4)  by  m’(r),  using  the  fact  that  m*(r)/f-»£{aj}/£{5j}  as  r— « o  and  the 
continuous  mapping  theorem  we  obtain  the  desired  result.  □ 

The  labelled  jobs  method  prescribes  selection  of  a  single  state,  ;Q,  of  the  job  stacti 
process  along  with  vQ  m  €  T  and' simulation  of  V°  in  blocks  defined  by- 

exits  from  the  set 

i(r0,/j'1,/ig,...,/t'v,.:Q,.rjj,/ig,...,/tiy)  £  £°:  (rg,/i-,r0,/»,)  “  vQ  for  some  i,  ls/s,V). 

By  Lemma  (4.1) 

«.*(»> 

f,/2  ( ~~o —  2  /(*!>  -  '(/)) /[(*{«?}>  »°(/)/ £{<*?}]  -  mi) 

v  m  (f)  7 

as  where  <5^  is  the  length  of  a  block  and  m°(:)  is  the  number  of  passage  times 
(irrespective  of  job  identity)  completed  in  the  interval  (0,/].  This  c.l.t.  implies  that  the 
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half-length  of  the  confidence  interval  obtained  from  a  simulation  of  fixed  length  is 
proportional  to  the  quantity  e°(/)  defined  by 

A/)  -  (£{*?»1/2<t0(/)/£{«?},  (4.5) 

where  (<r°(/))2  -  a2(Y^(/)-r(/)a^)  and  Y^(f)  are  as  in  Section  3.  (We  assume  that 
2  o  2 

£{(ap  }<»  and  •EJO'jC  I/I ))  }<«.  This  makes  it  possible  to  apply  Lemma  (4.1).) 

Since  the  numerator  in  this  c.l.t.  and  the  limit  (iV(0,l))  is  independent  of  the  state  vQ 
selected  from  T,  so  is  the  denominator;  this  is  a  consequence  of  the  "convergence  of 
types"  theorem  (cf.  Billingsley  [2],  Theorem  14.2).  Thus  <°(/)  is  an  appropriate  measure 
of  the  statistical  efficiency  of  the  labelled  jobs  method. 

.The  marked  job  method  prescribes  selection  of  x'  -  (z  ,n)  e^jand  simulation  of  V 
in  blocks  defined  by  the  successive  entrances  to  the  set 

{(z0JV,z\/i*)£S':  s’  -  z  .  n  -  n'\. 

* 

By  Lemma  (4.1) 

m 0)  *  _  •  ’  ,,  _ 

sl/2  y  /(£„)  -  r{/)\ /[(£{«!})  •(/)/£l«1}J  -  JV(O.l)  (4.0) 

\m(t)  nml 

as  t  ■»<*>,  where  is  the  length  of  a  block  and  m(t)  is  the  number  of  passage  times 
completed  in  the  interval  (0,/j.  By  an  argument  similar  to  that  used  for  the  labelled  jobs 
method,  an  appropriate  measure  of  the  statistical  efficiency  of  the  marked  job  method  is 
the  quantity 

e(f)  -  {E{5x})Ulo(f)/E{a]},  (4.7) 

where  (<*(/))2  -  <»2(Tl(/)-r(/)al)  and  Yx(f)  are  as  in  Section  3.  We  shall  show  that 
e°( /)*<(/)  for  all  functions  /. 
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la  terms  of  the  single  state  z0  of  the  job  stack  process  and  the  state 
Vq  ■  €  T,  define  subsets  Ul,U2 . UN  of  by 


Ul  -  {(z0,m  1 j >•••)/> y^Q,/rt  j .... j y)  € 


1  ziiN.  According  to  this  definition,  entrance  of  V°  to  the  set  U‘  corresponds  to 

termination  of  a  passage  time  for  job  1  (in  position  m1  of  job  stack  rQ)  with  jobs  2 . i  in 

fixed  positions  of  job  stack  Sq.  Observe  that  the  times  at  which  V°  hits  the  set 

U‘  are  a  subsequence  of  the  times  at  which  V°  hits  the  set  U'~x.  Comparison  of  the 
marked  job  and  labelled  jobs  methods  rests  on  c.l.t.’s  in  continuous  time  for  U1  blocks 
(defined  by  the  successive  exits  from  the  set  U‘)  of  V°. 

.Denote  by  <5^ the  length  of  the  Icth  U‘  block  of  V°,  kz  1.  Let  <x£  be  the  number  of 
passage  times  for  job  j  in  the  £th  U‘  block  and  let  be  the  sum  of  the  values  of  the 
function  /  for  these  passage  times,  1  ijii.  Then  set  e*1  »  (Z{<Sj})l/  <r,V£{<rf},  where 

(<r,Y)"  -  <j*(  Y^-r(  f)a^)  for  all  k.  We  denote  the  analogous  quantities  for  jobs  1,2 . j  by 

a^‘,  Y'jp',  and  e^)l  »  a^‘/E{a^'},  respectively;  here 

(0U)i)2  -  oh  Y^-KfU^). 


We  require  three  lemmas.  The  first  asserts  that  the  statistical  efficiency  of  a 
simulation  based  on  observation  of  passage  times  for  job  1  (the  marked  job)  in  Ul  blocks 
is  the  same  as  for  a  simulation  based  on  observation  of  passage  times  for  job  i  in  U‘ 
blocks,  ls/s.V. 

(4.3)  LEMMA.  eu  - 

Proof:  Recall  that  .V'(r)  is  the  position  of  the  job  labelled  /  in  the  job  stack  at  time  t. 
Consider  the  process  X‘  «  {.Y'(:)./iO},  where  X‘(:)  -  (Z(/),.v'(r)).  Let  L'(t)  be  the 
last  state  occupied  by  X'  before  jumping  to  X'(t)  and  set  V*  m  { V'(t):tzQ},  where 
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y‘U)  m  (/)).  Let  be  the  sequence  of  passage  times  for  job  / 

enumerated  in  termination  order.  Observe  that  the  successive  entrances  of  V*  to 
v0  m  are  regeneration  points.  Based  on  these  vq  cycles  (for  some  e‘)  by 

Lemma  (4.1) 

m\t) 

( -f-  2  M>  -  */>) A1’  - 

V  m  (/)  n_l  7 

as  r-»aa,  where  m‘(t)  is  the  number  of  passage  times  for  job  i  completed  in  (0,r]. 

Similarly,  based  on  U‘  blocks  of  V*, 

m‘0 ) 

,1/2  /  _J_  £  /(ya)  -  r(f>)  / ea  -  mi)  (4.9) 

'  m‘{t )  7 

as  /*•«.  Since  the  numerators  and  the  limits  are  the  same,  the  denominators  must  be  the 
same;  i.e.,  eli  m  e. 

The  desired  result  follows  since  e‘  m  e11.  To  see  this  set  »  inf{r>0:  V‘{t)  -  vQ} 
and  consider  the  process  W *  a  { W^(r):r!sOh  where  W‘(t)  -  r(S\  +  t).  Both  V  and  J?" 
are  generalized  semi-Markov  processes.  These  two  generalized  semi-Markov  processes 
have  the  same  probability  mass  functions  and  clock  setting  distributions  since  these 
building  blocks  are  functions  only  of  the  routing  matrix  and  the  parameters  of  the  service 
time  distributions,  and  the  jobs  are  stochastically  identical.  This  implies  that  V  and  W* 
have  the  same  finite  dimensional  distributions.  Enumerate  the  passage  times  for  job  / 
from  time  ^  as  and  let  mi(j)  be  the  number  of  passage  times  for  job  i 

completed  in  +  /].  Denote  the  sequence  of  passage  times  for  job  1  by  {P\:niO} 
and  let  m'(t)  be  the  number  of  passage  times  for  job  1  completed  in  (0,/j.  Now  consider 
the  functional  {Cl(t):taO}  of  V  where 
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c'(f)  -  -J—  2  f(?\)  -  */> 

«*(0  nm  1 

and  observe  chat  {C*(f):/iO},  where 

m‘U) 

C\t)  -  -i-  2  /<*«>  *  */> 

«'(/)  n-1 

is  the  same  functional  of  the  process  IF4.  Thus  for  ail  f>0,  0l(/)  and  C‘(t)  have  the  same 
distribution.  Since 

txn  Cl(0/eU  -  ^V(O.l) 

as  r-»<a,  and 

t1/2  C(t)/e  -  iV(O.l) 

as  r— •  by  Lemma  (4.1),  e  -  *u.  Q 

Next  we  show  that  simulations  based  on  observation  of  passage  times  for  jobs 

1,2 . j  in  U‘  blocks  and  on  passage  times  for  jobs  1,2 in  Ul+i  blocks  are  equally 

efficient. 

(4.10)  LEMMA.  Let  /  -  /  +  1.  Then  e0)'  -  «0)'  for  y-1,2 . i. 

Proof:  Set  ■  (z0,^i'1,^T2,...,mJc^:0,m1,/n2 . mk),  1  ikzN.  Consider  the  process 

X{k)  -  {A-(fc)(f):/aO},  where  X(k\t)  -  &(t)y\t),...yk(t)).  Let  L{k\t)  be  the  last 
state  occupied  by  X^k^  before  jumping  to  X^k\t).  Set  V ***  •  where 

ff*k\t)  m  (l}k^(t ),X^k\e))-  The  successive  entrances  to  state  are  regeneration  points 
for  the  process  and  the  successive  entrances  to  state  are  regeneration  points  for 
V*!\  Let  be  the  sequence  of  passage  times  for  jobs  l,2,...,y  enumerated  in 

termination  order.  Then 
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m^(t) 

tm  ( —  2  /(/£°>  *  r(f)) /<W  -  JV(0,1) 

as  /-»*>  and 

m^U) 

txn  ( — ~ —  2  / ■<*?>  -  '■(/>')  / -  mu 

V  «W(l)  *-l 

as  r—oo,  where  m^\i)  is  the  number  of  passage  times  for  jobs  1,2 . j  completed  in  (0,/]. 

Since  the  numerators  and  the  limits  are  the  same,  the  denominators  must  be  the  same.  □ 

Lemma  (4.11)  asserts  that  a  simulation  based  on  observation  of  passage  times  for 
jobs  1  and  2  in  U2  blocks  is  at  least  as  efficient  as  a  simulation  based  on  passage  times 
for  jqb  1  in  f/1  blocks.  The  idea  is  to  develop  a  bivariate  c.l.t.  for  passage  times  of  jobs 
1  and  2  in  U2  blocks,  apply  the  continuous  mapping  theorem  to  obtain  a  one  dimensional 
c.l.t..  and  make  an  identification  of  the  resulting  variance  constant. 

(4.11)  LEMMA.  ea)2seu. 

Proof:  Let  Wk  be  the  column  vector  with  components  W\  and  w\,  where 

Wk  m  Yk2-r(f)ak2  and  w\  ■  1 r*2«r(/)a|2.  Then  the  vectors  {Wk:kt 0}  are  LLd.  with 

mean  0.  It  follows  that 

n~xn  J  Wk  -  ,V(0,2), 

*•1 

as  n-*« o,  where  2  ■  {o^ j  and  <r,y  »  £{  for  i,j  •  1,2.  An  application  of  the 

continuous  mapping  theorem  using  the  mapping  A(wj,w2)  ■  Wj  +  yields 

n'U1  2  2  Wk~  wo.*2). 

kml  iml 


as  «-*oo,  where 


e2  ■  2  °u  +  2  2  V 

<  <</ 

Furthermore  from  the  form  of  this  c.lx  (since  w\  +  H^2  corresponds  to  jobs  1  and  2),  it 
is  dear  that  o~  »  (<7(252)",  ■  (<r12)2,  and  e22  *  (®22)2- 

Next  observe  that  e22  -  e11  by  Lemma  (4.8)  and  e12  »  e11  by  Lemma  (4.10). 
Using  the  definitions  of  e12,  e11,  and  e22,  these  results  imply 

*„  -  (elI)2£{a|}(£Ul2})2/[£I«f}(^«l1})2] 

and  • 

ff22  -  (•ll)2£n}}(£j«f 


Fran  the  Cauchy-Schwarz  inequality  we  have 

2 1  0j2  I  S  2(<tu<722)1/2-  (tfu)2£{5|}(2Z{a22}£{a1l2})/[£{5J}(£Ja,11)']. 


Hence 

(<r^  )  *  <7jj  4*  &22  ^  ^al2 

5  [(aU)2£{3{}(£{«f}  +  ^1«|2})2]/U{<S?}(£I«|1})2]- 

Since  £(«[2)2}  -  £[a22}  +  £{«}2},  *(2)2/<Usl.  □ 

(4.12)  PROPOSmON.  For  all  functions  /.  «°(/)  *<(/). 

P'oof  :  It  is  sufficient  to  show  that  «('Vl'v£en.  To  see  this  first  observe  (using 


Lemma  (4.1)  again)  that 
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m°(t) 

1/2  ( 2  -  r(f)) / ews  -  N(0,1) 

M  (/)  flail 


as  r-»« o  and 


fli°(0 

,1/2  f  ~n —  2  /<*!>  -  '</>) A°</>  -  mi) 

(t)  ffm  1 


as  /-►«,  where  m°(r)  is  the  number  of  passage  times  (irrespective  of  job  identity) 
completed  in  (0,;];  therefore  e(-ir*N  m  But  e(/)  -  e11;  this  foUows  from  the  c.Lt.’s 

of  Equations  (4.6)  and  (4.9)  (with  /■»!). 


We  first  show  that  e*3*3Se12.  Let  Wk  be  the  column  vector  with  components 
W\  and  W\,  where  W\  -  Y{k)2-r(f)a^  and  w\  -  Y^-r(f)c£.  Then  the  vectors 
[Wk:ki 0}  are  i.i.d.  with  mean  0  and  therefore 

n-m  2  Wk~N(0,Z). 

km  l 

as  n -*<*>,  where  2  »  {o^}  and  Oy  m  £{  W\  WJy}.  By  the  argument  used  in  the  proof  of 
Lemma  (4.11),  au  -  (<x(2)3)2,  and  <r22  «  (e33)2.  By  Lemma  (4.8),  #33  -  e11. 

Therefore 

e22  -  (en)2£{8}}(£{af  })2/[£{83}(£{a}1})2]. 

Next  observe  that  e(2)2s*11  by  Lemma  (4.11)  and  «*2)3  ■  e(2)2  by  Lemma  (4.10).  Thus 
e„S(an)2£{8}}(£{a(,2)3})2/[£{«3}(£{«l1})2]. 

By  the  Cauchy-Schwarz  inequality, 


(a(3)2)2seu  +  »22  +  2(<7no22),/2. 
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Using  the  fact  that  £{a(l3)3}  -  £{<*33}  +  £{«P)3}.  it  follows  that  e(3)3/ells;l.  The 
same  argument  (using  e^3***1)  shows  that  Continuing  in  this  way,  it  follows 

that  ew/fS€n.  □ 

5.  CONCLUDING  REMARKS 

The  assumption  chat  service  times  at  any  center  have  a  density  function  that  is 
positive  and  continuous  on  (0,*)  guarantees  (for  networks  with  single  states)  that 
{(.V(S„)J»rt+1):n2 0}  and  {(Z(7"°) J»®+1):niO}  are  regenerative  processes  in  discrete 
time.  The  proof  that  *°(/)se(/)  requires  only  that  the  proceses  be  regenerative. 
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